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Abstract 

In this paper, performance evaluation of Newton-Raphson and Conjugate Gradient method has been 
studied in comparison to Steepest Decent method for coverage and connectivity control in backbone based 
wireless networks. In order to design such wireless networks, the main challenge is to ensure network require¬ 
ments such as network coverage and connectivity. To optimize coverage and connectivity, backbone nodes 
will be repositioned by the use of mobility control based on above mentioned methods. Thus the network get 
self organized which autonomously achieve energy minimizing configuration. Furthermore by simulation using 
MATLAB J?2010a, methods are compared on the basis of optimized cost, number of iterations and elapsed 
time i.e. total time taken to execute the algorithm. 
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1 Introduction 

The need for assured end-to-end broadband connectivity and capacity limited flat ad hoc 
networks is driving communication networks to adopt layered wireless network architectures. 
These networks has diverse communication technologies and nodes with varying communica¬ 
tion capabilities at different layers. In particular a two layer network architecture consists of 
nodes of higher capability at upper layer known as base stations or backbone nodes. These 
nodes use directional wireless communications such as Free Space Optical or directional Radio 
Frequency to provide broadband connectivity to capacity limited flat ad hoc networks known 
as host nodes at lower layer as shown in figure [T} The use of directional wireless communi¬ 
cations at upper layer can be exploited very well since high data rates in Gb/s are provided 
by point-to-point communication links and it also provides interference free communication 
umm- These base station nodes form a backbone for the network since communication 
between two terminal host nodes takes place by multi-hop transmission scheme i.e. data sent 
by source (host node) first reaches to closest backbone node then it travels over the backbone 
network formed by backbone nodes until it reaches to that backbone node which is closest 
to the required destination node and from there it traverse few wireless nodes to reach the 
destination. 

The most important concern in layered wireless network architecture is assurance of host 
nodes getting proper coverage and maintenance of connectivity among the backbone nodes in 
dynamic wireless networks. However providing coverage and maintaining connectivity both 
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at a time is typically a competing objective. To maximize coverage, configuration of back¬ 
bone nodes have to be done in a region where host nodes (wireless users) are deployed and 
to maintain robust backbone connectivity, these backbone nodes have to be brought close 
enough to each other. 

Number of solutions has been proposed by various researchers related to the optimization 


Backbone-Based Wireless Networks 



Figure 1: Backbone based wireless network architecture [9] 

problems based on location, deployment and tracking of sensor networks[I3[ |12j . ‘Integer 
Linear Programming (ILP)’ model has been given by Chakrabarty that minimizes the cost of 
heterogenous sensor nodes which guarantees coverage provided by sensor nodes [6|. Hinojosa 
et al. has formulated the problem of dynamic multi-product of facilities location in a mixed 
integer linear programming model and minimized the total cost m- Genetic algorithm is 
also applied by various authors to optimize the given network mm- The benefit of applying 
Genetic algorithm is that function need not be continuous or differentiable. Similarly one of 
the solution is ‘Intersection point method’ to overcome blind areas in deployment of sensors 
|4j. Details on wireless sensor networks can be found in [7, SJ 11, 14. f!5l flT]. 

Jaime Llorca et al.|9] has optimized the joint coverage-connectivity problem for quadratic 
cost function based on gradient approach. Here the actual energy usage in the network system 
is based on the quadratic cost functions for both coverage and connectivity which has been 
defined in terms of the square of the distances between neighboring nodes. The net force on 
a backbone node is defined as the energy gradient at the location of the backbone node, and 
only depends on neighbor’s position information. Further Haijun Zhang et al. used Flocking 
algorithm and Particle Swarm Optimizer for similar joint coverage-connectivity optimization 
problem in [20] . 

In this paper, we study performance evaluation of Newton-Raphson and Conjugate Gra¬ 
dient method in comparison to Steepest Decent method for the quadratic minimization prob¬ 
lem formulated by Jaime Llorca et al. in [9]. 

2 Problem Formulation 

Let us recall the quadratic minimization problem given by Jaime Llorca et al. in [9j. As¬ 
sume that there is a network of M backbone nodes and N host nodes located in a region A, 
subset of R 2 in the plane. The host nodes are located at hi, fo, •••, hjv in the network, where 
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hi = ( Xi,yt ) represents the location of i th host node in A. Similarly, the backbone nodes are 
located at B\,B 2 , ...,Bm in the network, where Bj = (. Xj,Yj ) represents the location of j th 
backbone node in A. Coverage is provided to each host nodes which are in close proximity 
of backbone nodes. The process in which host node s will communicate with another host 
node d will be done in the following way: firstly host node s will transmit its data to the 
closest backbone node, from where it will traverse the backbone network until it reaches to 
that backbone node which is closest to the destination node. Finally, the backbone node 
transmit the data to intended host node d. 

Therefore this scheme depends on two aspects, firstly the backbone nodes must provide 
proper coverage to host nodes, which means that each host node is in the close proximity of 
at least one backbone node and secondly there must be good connectivity between backbone 
nodes. 

Both of these aspects are formulated as Coverage cost and Connectivity cost in [9] . 

Coverage cost 

Coverage is defined as how well a given region can be monitored. The Coverage cost is 
defined as the function of square distance of each individual host node to that backbone node 
which is providing coverage to it. If we increase the distance of host nodes from backbone 
nodes then coverage will decrease and after some more increment in distance host nodes may 
be in out of coverage mode and thus this coverage cost will increase on moving the backbone 
nodes far away from the host nodes. Assuming that bi(j) represents the index of the backbone 
node that provides coverage to the host node J, where 1 < bi(j ) < M. Now we can define 
coverage cost as: 

N 

h = Y,\hj~B u(j) \ 2 ( 2 . 1 ) 

3 =1 

where f± represents the coverage cost. This cost function will represents the energy 
usage by the backbone nodes in providing coverage to host nodes. 

Connectivity cost 

For maintaining connectivity between backbone nodes they can be simply connected to 
form a chain topology in which a single link connects all backbone node. But these types of 
simple graph are vulnerable to link failures as after any single link fail, the network becomes 
disconnected. Therefore it is very important to tolerate fault at some degree by maintaining 
proper connectivity in network. For a given connected network, the Connectivity cost is 
defined as the distance between connected backbone nodes. The connectivity cost function 
will increase on moving the backbone nodes far away from each other. 

Connectivity cost is defined as: 

M M 

a-EE I Bj - B k \ 2 C jk = tr(AC) (2.2) 

j =1 k =1 

where fi represents the connectivity cost, tr(.) denotes the trace of a square matrix, and 
C is an M x M matrix that represents the backbone connectivity graph, i.e., Cj k = 1 if there 
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exists a link between backbone nodes j and k, moreover A jf. = \Bj — | 2 and therefore A is 

the M x M distance squared matrix of the backbone nodes with A^ as its jk entry. This cost 
function will represents the energy usage by network to keep the backbone nodes connected. 


Now the total cost function can be defined as the sum of coverage cost and connectivity 


cost : 


N 


f = h + A/2 = Y, \ h i - B H3) I 2 + Xtr ( AC ) 

3 =1 


(2.3) 


which gives the total energy usage for the given network. In the above cost function 
relative importance of both the aspect i.e. coverage and connectivity is maintained by positive 
coefficient A. For smaller value of A, coverage is more important, while for large value of A, 
higher priority will be given to connectivity and tries to keep the backbone nodes close to 
each other. 


3 Optimization Algorithms 

To optimize the objective function, certain iterative schemes has been employed for which 
search direction will be computed first and then decide, how far to move along that direction. 
The success of this iteration depends on effective choice of both direction 4 and step length 
4 - The algorithms Steepest descent and Newton Raphson which has been used in this paper 
require direction 4 to be a descent direction, one for which (V/(x4),4) < 0, as this 
property guarantees that the function / can be reduced along this direction ( where x^ 
denotes x G R 2 at k th iteration) i.e. 

If <V/(sW),d fc > <0, 

then + 44 ) < / 4 (fc) ), V 4 € (0,4). 
where (,) is the notation for usual inner product between vectors in R 2 . 

3.1 Steepest Descent Method 

In Steepest descent method, optimization of cost function (i.e. providing proper coverage 
and maintaining connectivity) is governed by the iterative scheme given as follows 

xf +l) = xf ) + 4 4 (3.1) 

where x X '' 1 denotes the location of the backbone node j at the k th iteration, 4 is a step size 
and 4 is steepest descent direction. 

The steepest descent direction at the location of the j th backbone node can be defined 
as: 

4 = -V/j (3.2) 

where V/j denotes the gradient of function / at j th backbone node. 


4 



To compute step length <5, we know that a quadratic function f(x), which can be ex¬ 
pressed as 

fix) = *( x,Qx ) - (b,x) 

where Q is symmetric and positive definite matrix and iGfi 2 , 


Let </>(6) = fix {k) + <54) = - SVf(x^)) 

=> </>(<5) = ^(x (fc) - <5V/(x (fc) ),Q(x( fc) - <5V/(x (fc} ))) - (6,x (fc) - 5V/(.x (fc) )) 
For suficiently small value of <5, we have (j) (<5) = 0 


(V/(iW),V/(iW)) 
" <V/(4 fc )),QV/(x( fc ))} 


so the relocation of backbone nodes in Steepest descent method will be governed by 
equation (3.5) based on step size given in (3.3). 


Since in Steepest descent method, the direction of descent at every iteration is perpen¬ 
dicular to descent direction at previous iteration which makes this process slow as it follows 
zig-zag path to reach the optimized solution. Hence cost function has also been optimized 
by using Newton-Raphson and Conjugate Gradient method and it will be verified that the 
Conjugate Gradient method will take less time to optimize the cost function but there also 
exists tradeoff among these algorithms which has been shown later in simulation part. For 
performance evaluation, the results given by these algorithms has been compared based on 
optimized cost, number of iterations and elapsed time i.e. total time taken to execute the 
algorithm. 


3.2 Newton-Raphson method 

In general for the real valued function f(x 1 , 2 : 2 ), if all second order partial derivatives of / 
exist and are continuous over the domain of the function, then the Hessian matrix of / is 
given by 

/ a 2 / a 2 / \ 

H = V 2 /(z) = g) 9 % d f X2 (3.4) 

y dx2&x\ dx'% J 


where x = (aq, £ 2 ). 

A matrix is said to be positive definite if all its eigen values are positive. 

For function f(x) which is strongly convex and twice differentiable, the iterative sequence 
using Newton’s method [2j will be 

xf +1) = x^ + S k 4 (3.5) 

where descent direction 4 is given by 

4 = —(V 2 /^))-^/^) 
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and 5 k = 1 has taken. Thus by Newton’s method, iterative scheme is given as 

x (k+i) = x (k) _ ( V 2 /(x (fc) )) -1 V/(x (fc) ) 

3.3 Conjugate-Gradient Method 

In this method, in place of descent direction, set of conjugate vectors are generated which 
are known as conjugate direction along which optimization of cost function will take place. 
First conjugate direction do will be steepest descent direction at the initial point xq. After 
this successive one-dimensional minimizations will take place along each of the conjugate 
directions dk until convergence is achieved. For details one can refer mm- 

The iterative scheme is given by = x (k) _|_ where 

5 = ~(9r k ,d k ) 
k {dkiHkdk) 

and Conjugate direction is governed by equation 

4+1 = - gr k+ 1 + 4 4 


where 

= {gr k+1 ,H k d k ) 

( 4 ,^ 44 ) 


and gr k denotes gradient at k th iteration. 
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4 Simulation Results 


In order to compare the performance of various algorithms used for coverage and connectivity 
control in adhoc network, the optimization algorithms are implemented using MAT LAB 722010a. 
For simulation purposes, a network of 20 host nodes, uniformly distributed in a 100 x 100 
two dimensional plane has been considered. Initially the first host node is placed randomly 
any where in the plane and other host nodes are placed within cluster range of the previous 
host node with probability p and uniformly in the 100 X 100 plane with probability (1 — p). 
After placement of host nodes, 10 backbone nodes are placed at random in the plane and 
an initial ring topology is built connecting all backbone nodes. Then the Optimization al¬ 
gorithm is executed to make backbone nodes adjust their position until convergence to the 
optimized network is achieved. The performance of different optimization algorithms namely 
Steepest Descent, Newton Raphson and Conjugate Gradient method are evaluated in terms 
of optimized cost, number of iterations and execution times. All results are compared on the 
basis of average over 20 independent networks. 

Figure [2] shows the randomly generated initial network of 20 host nodes and 10 backbone 
nodes. The backbone nodes are shown with red circle and links between them are shown with 
blue lines. Each host nodes are shown with green circle and links between backbone nodes 
and host nodes are shown with red lines. 


O Backbone node 



Figure 2: Initial Network Configuration 


For the initial network given in figure [2j the optimized network obtained using different 
algorithms is shown in figures [3] for A = 1. From equation 2.3 


it is clear that when A = 1, 
Further as the value of A in- 
In order to verify the 


coverage and connectivity has been assigned equal weightage. 
creases, weightage of connectivity increases at the cost of coverage, 
effect of increasing A, the optimized network for A = 5 and 15 are shown in figures [4] and [5] 
respectively. It can be seen from these figures that backbone nodes start coming closer to 
each other in order to maintain more connectivity. Similarly, when value of A decreases then 
weightage assigned to coverage gets increased and thus backbone nodes start going closer to 
host nodes in order to provide them more coverage as evident from figures [6] and [7] for the 
value of A = 0.5 and 0.1 respectively. 


7 









Figure 3: Optimized network by different algorithms for A = 1 



Conjugate Gradient 



Figure 4: Optimized network by different algorithms for A = 5 



Conjugate Gradient 



Figure 5: Optimized network by different algorithms for A = 15 


The success of Steepest descent method depends on effective choice of both the descent 
direction and step size. In computing the step size 8k there exists a tradeoff as we would like to 
select 8k such that it gives a substantial reduction in /, but at the same time we do not want to 
give too much time making the choice but in general, it is too expensive to identify this value. 

For simulation purpose, we have assumed that for any randomly generated initial net¬ 
work, every backbone node is connected with two other backbone nodes (to maintain connec¬ 
tivity) and to atmost 20 host nodes (to maintain coverage). Based on this assumption and 
using (|3.3[), we find an interval containing desirable step size. Since sufficient step size 5k is 
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Figure 6: Optimized network by different algorithms for A = .5 



Conjugate Gradient 



Figure 7: Optimized network by different algorithms for A = .1 


necessary in order to ensure better optimization as shown in figure [8j [9j and 
manually some value of step size from obtained interval of desirable step size. 

For A = 1 and the step size 5 £ (1/22,1/2), if the step size increases and move towards 
right extremity of this interval, we get networks in which backbone nodes starts relocating 
outside the assumed plane as shown in figure [8j For example, if the step size 6 = .51 > .5 
(i.e. outside the interval) we don’t get an optimized network and it also leads to increase in 
cost function. 


10. We choose 


For A = 5 and step size 5 £ (1/30,1/10), no optimized network is obtained as all step 
size taken in figure are greater than right extremity i.e. 1/10. as shown in figure [9] 


Similarly, for A = .55 and step size 6 £ (1/21,1), an optimized network is obtained since 


all step size lies within the interval as shown in figure 10 
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Steepest Descent for 8=.2 
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Figure 8: Optimized network by Steepest Descent for A = 1 


Steepest Descent for 5=.2 



Steepest Descent for 8 =.4 
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Steepest Descent for 8 =.51 
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Figure 9: Optimized network by Steepest Descent for A = 5 


Steepest Descent for 8=.2 


Steepest Descent for 



Steepest Descent for 8 =.49 




Figure 10: Optimized network by Steepest Descent for A = .5 


For performance evaluation, algorithms are compared on the basis of optimized cost, 
number of iteration and total time taken to get an optimized network. Since algorithms are 
executed every time for different initial networks, therefore comparison has been made on the 
average taken from 20 independent networks. For comparison, A = 1 has taken. 


Figure 11 presents the comparison of different optimization algorithms in terms of aver¬ 
age optimized cost (average over 20 independent networks). From this figure it can be seen 
that the initial cost of the network is approximately 74294 and the cost of optimized network 
is in the range of 13637 to 15154. Among the different optimization algorithm, the Steepest 
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Descent gives minimum cost. It can be also observe from the figure that, Steepest Descent 
and Conjugate Gradient have almost similar performance in terms of average optimized cost. 


Figure 12 shows the comparision of average number of iterations (average over 20 in¬ 
dependent networks) taken by each algorithm. From this figure it can be observed that, 
Steepest Descent method takes least number of iterations. Between Newton-Raphson and 
Conjugate Gradient method, Conjugate Gradient has relatively lesser number of iterations, 
therefore it may be concluded that Steepest Descent is best among all optimization methods 
in terms of number of iterations. 


Although the Steepest Descent has lesser number of iterations but its elapsed time is 
relatively higher than Conjugate Gradient method as shown in figure [13J It means that the 
Conjugate Gradient method takes lesser time to perform an iteration. 




Optimization Algorithms 


Figure 11: Average optimized cost by different algorithms 



Optimization Algorithms 


Figure 12: Average number of iteration by different algorithms 
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Optimization Algorithms 


Figure 13: Average time taken by different algorithms 


Further in order to support the discussion made earlier on the figure ll| 12 and 13, the 
value of corresponding metrics for each of the 20 independent networks are shown in figure 
14| 15 and 16 to verify the consistency of results. 


-•-Steepest Descent -*-Newton Raphson -“-Conjugate Gradient 



Network ID 


Figure 14: ‘optimized cost’ of 20 random network by different algorithms 





Figure 15: ‘number of iteration’ by different algorithms to optimized 20 random network 
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Figure 16: ‘time taken’ by different algorithms to optimized 20 random network 

5 Conclusion 

In this paper, performance evaluation of Newton-Raphson and Conjugate Gradient method 
has been studied in comparison to Steepest Decent method for optimizing network coverage 
and backbone connectivity in backbone based wireless networks by adjusting the position 
of backbone nodes. Through simulation it has been found that Conjugate gradient method 
takes lesser time than other methods to optimize both coverage and connectivity but Steep¬ 
est descent method does better optimization of coverage and connectivity. Thus there exists 
trade-off among the results obtained by Steepest Descent, Newton-Raphson and Conjugate 
Gradient method. When accuracy is needed, Steepest Descent is preferred, while if time is 
more important factor, Conjugate Gradient method is preferred. 

Since we have not taken into consideration the real world constraints such as power 
limitations, link blockage by terrain and capacity of base stations, therefore in our future work 
we will try to optimize the network coverage and backbone connectivity by using different 
optimization techniques and evaluate their performances by considering the above real world 
physical constraints. 
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